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ABSTRACT 

An evaluation was done of compensatory educational 
programs in reading and mathematics in the Saginaw (Michigan) School 
District. The elementary Compensatory Education (CE) program is both 
a push-in format (grades 1 and 2) and a pull-^out format (periodically 
taking students out of regular classrooms) that serves 2,045 students 
in grades 1 through 6. Also included is a pull'-out Reading Recovery 
program for grade 1 serving 55 students and piloted in December of 
1991. The secondary CE is a self-contained classroom program that 
involves approximately 772 students in grades 7 through 12. Also 
included is the Thinking Skills Program (TSP) for grades 7 through 9. 
The process evaluation focused on supportive services provided by the 
pupil service team and project success. The evaluation proceeded 
using structured interviews with eight key staff members, a review of 
logs for the pupil service team, and an analysis of the results of 
student test performance on the California Achievement Tests. Results 
of the Reading Recovery Pilot suggest that this program has promise. 
Data from the pre- to post-testing of CE students indicate that 
overall greatest gains in reading were made in grade 1. Grades 1 
through 3 attained the performance standard in basic and advanced 
skills. Grades 9, 10, and 12 attained the performance standard in 
basic skills. Mathematics gains were the greatest in grade 3 (basic 
skills) and grade 1 (advanced skills). Included are 27 tables. Six 
appendixes, which comprise about half of the document, contain counts 
of program participants and technical information on program 
evaluation and administration. (JB) 



i< Vc yc :fr Vc Vc it ?V Vc Vc t\ Vc ^'c ic ■>*: V« t\ •!< ic ?'c Vf iV fc it Vc it it it i: it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it 

neprooucLions suppiieo oy cDKb are tne best that can be laade 
from the original document. 

i7iticiti<iti<itititi<iticititi<iti<ititi<i<i(iti<itititititi<it^iti<i<itititi<iti(^ 




OOnBBftTOWf EDOCfinCN PHCIXJCT ENWIllftTICN: 
EiaffiHERRI AND SBOONDRia EBOOWIB 
1991-1992 



DEPARTMENT OF EVALUATION SERVICES 

- PROVIDING ASSESSMENT. PROGRAM EVALUATION AND RESEARCH SERVICES - 




"PERMISSION TO REPRODUCE THIS 
MATEf|^L HAS BEEf^5«ANTED BY 



^S BEEN^RANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



SaginaWf Michigctn 



OQMPQISAXGRY EDUCATIGN FBGCOCT BVMIIATICK: 
ELQ1ENIARY AND SEOOtJDMCl PROGRAMS 
1991-1992 



An ^proved Report of the 
DIVISION OF ADMINISTO\TION AtJD PERSONNEL 
Departinent of Evaluation./ Testing and Research 



Dr» Foster B. Gibbs, Superintendent 
School District of the City of Saginaw 




August, 1992 



TABLE OP catmns 



Page 



PROGRAM DESCRIPTION 1 

PIOCECURES FOR EVALUATION 4 

PRESENTATION AND ANALYSIS OF DATA: PRODUCT 6 

Product Data: Reading Basic Skills 6 

Product Data: Reading Advanced Skills • 7 

Product Data: f-fethanatics Basic Skills 10 

Product Data: Mathematics Advanced Skills 11 

Product Data; Reading Recovery Pilot 14 

SUMMARY AND CONCLUSIONS 21 

RECOMMENDATIONS 25 

APPENDICES 27 

Appendix A: 1991-92 Count of Program Participants 28 

Appendix B: Mean Normal Curve Equivalent Gain by Building and 
Grade for Chapter 1/Article 3 Pupils in Reading 
and Mathematics Based on April-May, 1991 Pre- 
Testing and ^ril-^flay/ 1992 Post-Testing on CAT 
(Spring to Spring) ^ «• 37 

Appendix C: Checklist for Middle School Principals {Conditions 
Under "Which the HOTS Program is Effective for 
Chapter 1 and LD Students) 51 

^pendix D: Eight Chapter 1 Conponents from the 1989-90 Basic 

Application c 53 

Appendix E: Memo and Associated Interview Forms Related to 
Phase I Process Evaluation Fact Finding and 
Suggestions Concerning Chapter 1/Article 3 
Pupil Service Tean (PST) Process and Project 
Success 61 

Appendix F: Diagnostic Survey's Text Reading Numerical Score 

Conversion to Basic Reading Levels 70 



4 



LIST OF TMSLFS 



Table Page 

1 Attainment of the Performance Standard for Total Reading in 
Nomial Curve Equivalent Scores for Conpensatory Education 
Participants, Grades 1-10 and 12, 1991-92 7 

2 Attainment of the Perfomance Standard for Reading Compre- 
hension in Normal Curve Equivalent Scores for Compensatory 
Education Participants, Grades 1-10 and 12, 1992-92 8 

3 Attainment of the Performance Standard for Total f4athematics 
in Normal Curve Equi^^alent Scores for Conpensatory Education 
Participants, Grades 2-10 and 12, 1991-92 10 

4 Attainment of the Performance Standard for f4athematics Con- 
cepts and Applications in Nomal Curve Equivalent Scores for 
Conpensatory Education Participants, Grades 1-10 and 12, 

1991-92 11 

5 f4eans and Standard Deviations for All Reading Recovery 
Children and Random Sample of First Graders on Six treasures 

from the Diagnostic Survey , December and May, 1991-92 17 

6 Mean Normal Curve Equivalent (NCE) Gain Scores for Grade 1 
Reading Recovery, Conparison, and District-Wide Groups in 
Reading Vocabulary, Reading Cortprehension, and Reading 
Total Based on ^ril-May, 1991 Pre-Testing and April-f-lay, 

1992 Post-Testing on CAT (Spring to Spring) 19 

B.l Mean Nomal Curve Equivalent Gain by Building and Grade for 
All 1-6 Chapter 1 Pupils in Total Reading (Basic Skills) 
Based on April-t4ay, 1991 Pre-Testing and ^ril-May, 1992 
Post-Testing on CAT (Spring to Spring) , 37 

B.2 Mean Normal Curve Equivalent Gain by Building and Grade for 
All 1-6 Chapter 1 Pupils in Reading Coirprehension (Advanced 
Skills) Based on April-May, 1991 Pre-Testing and i^ril-flay, 
1992 Post-Testing on CAT (Spring to Spring) 38 

Be3 Mean Normal Curve Equivalent Gain by Building and Grade for 
All 1-6 Chapter* 1 Pupils in Total Mathematics (Basic Skills) 
Based on ^ril-May, 1991 Pre-Testing and ;^ril-May, 1992 
Post-Testing on CAT (Spring to Spring) • 39 

B.4 Mean Norral Curve Equivalent Gain by Building and Grade for 
All 1-6 Chapter 1 Pupils in Mathematics Concepts and ^pli- 
cations (Advanced skills) Based on April-May, 1991 Pre- 
Testing and April-May, 1992 Post-Testing on CAT (Spring to 
Spring) 40 



ii 

5 



LIST CF TRBLES (OQNT. ) 



Table Page 

B.5 Mean Nontial Curve Dguivalent Gain by Building and Grade for 
All 7-9 Chapter 1 Pupils in Total Reading (Basic Skills) and 
Reading Coqprehension (Advanced Skills) Based on April-May, 

1991 Pre-Testing and i^ril-May, 1992 Post-Testing on CAT 

(Spring to Spring) 41 

B,6 r^an Normal Curve Equivalent Gain by Building and Grade for 
All 7-9 Chapter 1 Pupils in Total Mathematics (Basic Skills) 
and Mathenatics Concepts and implications (Advanced Skills) 
Based on April-May, 1991 Pre-Testing and April-May, 1992 
Post-Testing on CAT (Spring to Spring) 42 

B,7 Ptean bJormal Curve Equivalent Gain by Building and Grade for 
All 10-12 Chapter 1 Pupils in Total Reading (Basic Skills) 
and Reading Comprehension (Advanced Skills) Based on April- 
May, 1991 Pre-Testing and April-Play, 1992 Post-Testing on 
CAT (Spring to Spring) 43 

B,8 Mean Norrnal Curve Equivalent Gain by Building and Grade for 

All 10-12 Chapter 1 Pupils in Total Mathematics (Basic Skills) 
and Mathematics Concepts and /^plications (Advanced Skills) 
Based on April-May, 1991 Pre-Testing and April-flay, 1992 
Post-Testing on CAT (Spring to Spring) «• 44 

B,9 Mean Normal Curve Equivalent Gain by Building and Grade for 
All 1-6 Article 3 Pupils in Total Reading (Basic Skills) 
Based on April-May, 1991 Pre-Ter,ting and April-May, 1992 
Post-Testing on CAT (Spring to Spring) 45 

B.IO Mean Normal Curve Equivalent Gain by Building and Grade for 
All 1-6 Article 3 Pupils in Reading Conprehension (Advanced 
Skills) Based on ^ril-May, 1991 Pre-Testing and April-flay, 

1992 Post-Testing on CAT (Spring to Spring) 46 

B.ll r^an Normal Curve Equivalent Gain by Building and Grade for 
All 1-6 Article 3 Pupils in Total Mathematics (Basic Skills) 
Based on April-May, 1991 Pre-Testing and April-May, 1992 
Post-Testing on CAT (Spring to Spring) 47 

B.12 Mean Normal Curve Equivalent Gain by Building and Grade for 
All 1-6 Article 3 Pupils in Matheinatics Concepts and Appli- 
cations (Advanced Skills) Based on April-flay, 1991 Pre- 
Testing and April-^!ay, 1992 POst-Testing on CAT (Spring to 
Spring) 48 

B.13 Mean Normal Curve Equivalent Gain by Building and Grade for 
All 7-9 Article 3 Pupils in Total Reading (Basic Skills) and 
Reading Comprehension (Advanced Skills) Based on April-May, 
1991 Pre-Testing and April-May, 1992 Post-Testing on CAT 
(Spring to Spring) 49 



iii 



LIST OF TABLES (0011.) 



Table Page 

B,14 Mean Normal Qirve Equivalent Gain by Building and Grade for 
All 7-9 Article 3 Pupils in Total Mathematics (Basic Skills) 
and Mathonatics Concepts and Applications (Advanced Skills) 
Based on April-May r 1991 Pre-Testing and ^ril-May, 1992 
Post-Testing on CAT (Spring to ^rivig) 50 



IV 



FROCSLVl DESCRIFriGN 



The School District of the City of Saginaw operates a supplemental 
eciucational delivery system in reading and mathematics consisting of two 
prograims - elementary and secondary Conpensatory Education {CE)» The 
elementary CE is both a push-in program (that operates in the regular 
classroom in grades one and two) and pull-out program (periodically taking 
students out of regular classrooms) that serves 2,045 students in grades one 
through six. The Reading Recovery program (a pull-out intervention in reading 
in grade one serving approximately 55 pupils) was piloted starting in 
December, 1991. The secondary CE is a self-contained classroom program which 
involved approximately 772 students in grades seven through twleve. In its 
second year was the Thinking Skills Program (ISP) that operated in grades 7-9 
in a self-contained room setting."^ The CE programs are funded by both the 
Federal Education Consolidation and Improvement Act (ECIA) Chapter 1 and 
Article 3 of the State School Aid Act. 

Summarized in the chart below are demographic characteristics that 
describe both the elementary and secondary levels on CE in greater detail. 



The Thinking Skills Program (TSP) is the local name for the nationally 
validated Higher Order Thinking Skills (HOTS) program. See Appendix C for a 
checklist for middle school principals interested in HCTS for a further in- 
depth operational description. 
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As can be seen fran the chart above , the primary purpose of the programs 
is to inprove the reading and mathematics achievement of a designated number 
of educationally disadvantaged children. The children in the program are 
screened for entry with the California Achievement Tests — Form E/F (CAT). 
Students were determined eligible for the CE programs if they scored at or 
below the 36th normal curve equivalent (NCE) on the reading vocabulary and/or 
mathematics corrputation subtests of the CAT (this is equivalent to a score at 
or below the 25th percentile). Tliis year approximately 2,817 pupils are 
participating in the ccnpensatory education programs. 

This year there were eight other progran conponents in addition to the 
basic CE prograns tliat were added to the overall program. These oonponents 
included the following: Home-School Aides? Parent Involvement/ Training; 
Staff [Development; Pupil Assistance Team; Elementary After-School/ Extended 
Day Program; Conputer Assisted Learning Lab/After School for grades 7-9; 
Secondary After^School Tutoring grades 7-9 and 12? and Project Success. A 
description of each of these eight cooponents can be found in ^pendix D. 

The broad goals of these basic CE programs were to; 1) provide intensive 
academic instruction to the educationally disadvantaged, 2) involve parents in 
the program, 3) supply students with incentives for academic ajhievement, 4) 
cerate staff inservice pirograms, 5) measure academic grcwth, and 6) prepare 
students to effectively meet the academic cotpetition of the general 
classroom. These goals are the focus of the Compensatory Education 
Department's activities throughout the 1991-92 school year. 
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FUCXmiRES PGR EVMUATIGN 

Both process and product evaluations were undertaken for the conpensatory 
education delivery systert. This year's process evaluation efforts focused on 
supportive services provided by the pupil service team (consisting of 
cainselorsr social worker r psychologist and building staff) and project 
success (special assistance program for students who have not shown positive 
academic growth for the past two years). Structured interviews were conducted 
in November^ 1991 of eight key staff members involved in the provision and 
coordination of these services. The results were not written up in a formal 
process evaluation but rather shared in the fonn of an internal memo dated 
December 2^ 1991 (see App'^rKiix E for a copy of this memo). In addition, the 
Evaluation Department also has reviewed and summarized time legs for the pupil 
service team (PST) and project success as part of an on-going monitoring 
effort during the course of the 1991-92 school year. 

The product evaluation, which is the focus of this report, addresses the 
results of student test performance. The California Achievement Tests — Fom 
E/F (CAT) nom^d Spring, 1985 for grades 1-12 served as the evaluation 
instruments. These tests were administered on a pre-test basis in the Spring, 
1991 and on a post-test basis in Spring, 1992. 

Pfean pre- to post-test score conparisons were used to evaluate the 
effectiveness of the delivery system. The agreed upon standard was an 
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Inprovement greater than two normal curve equivalent (NCE) points from pre- to 

______ 

post-testing. The reading (both basic and advanced skills) ard then the 

mathematics (both basic and advanced skills) results for the entire CE 

3 

delivery system will be presented. 



A NCE is very similar to a percentile rank (ranging fran 1 to 99 with a 
mean of 50) with the additional advantage of being based on an equal interval 
scale. Federal and State educational officials are increasing requiring 
outcome standards for cortpensatory education students be e3<pressed in NCE 
units and expressing state-wide results in these units. The 1991-92 School 
Aid Act set the standards for student and school average gains to exceed two 
NCE units for 1991-92 and to exceed three bCE units for 1992-93. Hie 
standards in this evaluation report have been revised to reflect this change 
fron the standard for 1988-89 through 1990-91 when gains were to exceed zero 
NCE units. 

^Ihe use of advanced skills as a maans to evaluate the progress of CE 
students represents a major change from past evaluation requirements which 
only required basic skills in reading and mathematics to be evaluated. The 
admin istrativo rules that required the measurement of advanced skills also 
required '"plans of improvement" fran Chapter 1 buildings experiencing an 
average gain of two NCEs or less in one or more skill/subject areas served. 
The 1991-92 school year marked the first year that Article 3 administrative 
rules were changed to include advance skill reporting and also **plans of 
inprovement" . 

13 
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FBESEimTION AND ANALYSIS OP QAXA: PRODUCT 



The primary goal of conpensatory education was to increase reading and 
mathematics achievement in both basic and advanced skill areas. Ihe data 
presented in this section will indicate the extent to which this goal was 
achieved. Reading and then mathematics data by grade are presented below. 
Vfliere relatively few students wre tested at any grade level and £or a 
buildingr the results should be viewed with caution . 

The achievement results by school for the entire program and each funding 
source separately are presented in Appendix B. 

In addition, a short section on the results of the Reading Recovery Pilot 
Project in grade one will be presented. The results presented focus 
exclusively on reading achievement. 

Product Data: Reading Basic Skills 

The pre- and post-test results for total reading are presented in 
Table 1. 
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TABLE 1. ATI3mifB7r OF THE PERFCX^f^^ 

IN NORMAL COFVE BQOIVMflffr SCORES FOR CXMPEMSMT»Y EDOCMICN 
PAKnCrPANIS, GRADES 1-10,, AND 12, 1991-92. 



Cotrparisons 
by Grade 


# of Students 
Pre- to Post- 
Tested 


Pre 
Mean 


Normal Curve 
Equivalents 

Post 
ffean 


Mean 
Gain 


Performance 
Standard* 
Attained 


1 


203 


24.1 


37.9 


13.8 


Yes 


2 


266 


22.2 


30.0 


7.8 


Yes 


3 


219 


28.6 


33.9 


5.3 


Yes 


4 


186 


31.5 


32.2 


0.7 


Mo 


5 


219 


32.1 


32.5 


0.4 


No 


6 


222 


31.6 


32.4 


0.8 


No 


7 


171 


30.2 


26.2 


-4.0 


No 


8 


182 


27.1 


27.1 


0.0 


No 


9 


148 


29.6 


32.2 


2.6 


Yes 


10 


36 


23-6 


25.8 


2.2 


Yes 


12 


16 


22.2 


25.6 


3.4 


Yes 



*Post-test NCE scores v;ill evidence an inprovement of more than two NCE points 
over pre-test scores. 



A study of the reading results shews that students net the performance 
standard at all grades except four through eight. At the seventh grade level, 
the score indicated the largest average loss of -4.0 NCE points respectively 
between pre- and post-testings. At grade five the largest gain (13.8 NCE 
points) was recorded. At the tenth grade level the smallest positive 
acceptable NCE gain {2.2 points) can be seen. See Appendix B for the test 
results by building and funding source. 

Product Data; Reading Advanced Skills 

The pre- and post-test results for reading conprehension are presented in 
Table 2. 
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IS^LE 2. ATIAIMHEtVr OF THE PERFOMANCE STANDARD FOR READING 
CQHPBBBENSIGN IN NORMAL CURVE BQimS^LENT SCORES FOR 
COHPOGKRIff ECtlCAIICN PiWnCIEWITS, 
GRADES 1-10 AW 12, 1991-92. 









Normal Curve 












Bcjuivalents 








# of Students 








Performance 


Conparisons 


Pre— to Post- 


Pre 


Post 


Mean 


Standard* 


by Grade 


Tested 


Mean 


Mean 


Gain 


Attained 


1 


203 


32.1 


39.0 


6.9 


Yes 


2 


266 


28.3 


32.6 


4.3 


Yes 


3 


219 


33.3 


35.9 


2.6 


Yes 


4 


186 


38.3 


35.6 


-2.7 


No 


5 


219 


34.6 


34.4 


-0.2 


No 


6 


222 


35.3 


34.6 


-0.7 


No 


7 


171 


34.7 


30.5 


-4.2 


No 


8 


182 


30.9 


31.1 


0.2 


No 


9 


148 


33.9 


31.8 


-2.1 


No 


10 


36 


30.9 


30.9 


0.0 


No 


12 


16 


28.5 


30.0 


1.5 


No 



*Post-test NCE scores will evidence an improvement of more than two NCE points 
over pre-test scores. 



A review of the advanced skills in reading results show that students 
attained the performance standard at grades two, three, and four. At the 
seventh and fourth grade levels the scores revealed an average loss of -4 .2 
and -2.7 respectively between pre- and post-testings. At grade three the 
largest gain (6.9 NCE points) was observed. At the ninth grade level the 
smallest acceptable positive NCE gain (2.6) can be seen. See ^pendix B for 
the test results by building and funding source. 

Overall in the area of reading the standard that post-test NCE scores 
will exceed two NCE units was attained in 6 of 11 (54.5%) and 3 of 11 (27.3%) 
grades levels for basic reading skills and advanced reading skills 
respectively. The administrative rules that required the inonitoring of 
progress in both basic and advanced skills also required "plans of 
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iitprovement" frcm buildings experiencing aggregate gains of two IKE units or 
-less -in- one or more- skill areas -served. 1^ below shows with an -X"-the 

buildings in the area of reading (basic and/or advanced skills) required to 
submit a plan of iirprovCTent for 1991-92 school year Chapter 1/Article 3 
results. 



1991-92 CHAPTER l/AKTICLE 3 BUILDINGS RBQDIRED TD SDBMIT 
READING PUSNS OP JMPSCNOWT. 

Basic Skills Advanced Skills 

High School 
Arthjr Hill 

Saginaw High X 
Junior High 

Central Jr. X X 
torth Int. X 

South Int. X X 

Vfebber Jr. X X 

Elementary 

Baillie X X 

Coulter X X 

Emerson X 
Fuerbringer X X 

Nelle Haley 
Handley 

Heavenrich X 
Herig 

Houghton X 
Jerome 

Jones X X 

Kenpton X 
Longfellow X 
Longstreet X 
J. Loctnis X 
Merrill Park 

Chester Miller X X 

John ^^oore X 
Morley 

J. Fouse X X 

Salina X X 

Stone 

Vfebber 

Zilwaukee 

Note; X = Aggregate gain two NCE units or less. 
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A review of the chart above shows that 20 buildings (one high school, 
,four junior highs, and 15 elementary schools) need to develop plans of 
improvement because their aggregate performance in basic and/or advanced 
skills was two NCE units or less. 

Product Data: Mathenatics Basic Skills 

Table 3 below presents the attainment of the performance standard for 
spring to spring data in grades 2-10 and 12 in total imthematics* 



TABLE 3. /mAHMEMT OT THE PERFORHANCE STANEABD FOR TOTAL MAIHQfATICS 
IN fOMAL CURVE BjnVMJENT SCORES FOR OCMPENSATCXOT EDUCATIGN 
BABnCIPANTS, GRADES 2-10 AMD 12, 1991-92. 









Normal Curve 












Equivalents 








# of Students 








Performanoe 


Comparisons 


Pre- to Post- 


Pre 


Post 


Mean 


Standard* 


by Grade 


Tested 


Mean 


Mean 


Gain 


Attained 


2 


184 


27.5 


37.1 


9.6 


Yes 


3 


182 


28.2 


39.5 


11.3 


Yes 


4 


179 


32.2 


39.0 


6.8 


Yes 


5 


113 


30.0 


37.9 


7.9 


Yes 


6 


86 


29.0 


37.7 


8.7 


Yes 


7 


63 


30.3 


27.2 


-3.1 


No 


8 


99 


27.3 


31.4 


4.1 


Yes 


9 


76 


29.1 


32.5 


3.4 


Yes 


10 


23 


30.3 


30.6 


0.3 


No 


12 


13 


25.9 


19.6 


-6.3 


No 



*Post-test NCE scores will evidence an iitprovQT>ent of irore than two NCE points 
over pre-test scores. 



A review of total mathematics results reveals that students met the 
performance standard in all grades except 1, 10, and 12. At the seventh and 
twelfth grade levelsr the scores indicated an average loss of -3.1 and -6#3 
NCE points respectively betvgeen pre- and post- testings. The gain at the third 
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grade level, indicated the largest NCE iirprovesnent (11.3 points) between pre- 
and post-testings. At the ninth grade, the srallest acceptable positive NCE 
gain (3.4 points) was observed. See Appendix B for the test results by 
building and funding source. 



Product Data: Mathematics Advanced Skills 

Table 4 below presents the attainment standard for students in grades 1- 
10 and 12 in mathematics concepts and applications. 



TABI£ 4. ATEAINMBHT OF THE PERFORMANCE STANDARD FOR MKrHEMATICS CCNCEPrS 
AND APPLICATIONS IN NCX91AL CUSVE BJUVM^NI SOOPES FOR 

ocMPENSMnRY mx:AnoN participanis, 

GRADES 1-10 AND 12, 1991-92. 









Normal Curve 












Equivalents 








# of students 








PerforTnance 


Conparisons 


Pre- to Post- 


Pre 


Post 


Mean 


Standard* 


by Grade 


Tested 


Mean 


Mean 


Gain 


Attained 


1 


262 


26.9 


46.6 


19.7 


Yes 


2 


184 


35.0 


38.5 


3.6 


Yes 


3 


182 


35.4 


41.9 


6.5 


Yes 


4 


179 


38.7 


40.4 


1.7 


No 


5 


113 


35.8 


40.5 


4.7 


Yes 


6 


86 


33.5 


37.9 


4.4 


Yes 


7 


63 


33.3 


29.9 


-3.4 


No 


8 


99 


30.2 


33.5 


3.3 


Yes 


9 


76 


32.2 


35.3 


3.1 


Yes 


10 


23 


33.0 


31.1 


-1.9 


No 


12 


13 


28.3 


20.6 


-7.7 


No 



*Post-test NCE scores will evidence an improvement of more than two NCE points 
over pre-test scores* 



A study of the advanced mathematics skills results show that students 
attained the perfonnance standard at all grades except 4, 7, 10, and 12. At 
the seventh and twelfth grade levels, the scores revealed an average loss 
of -3.4 and -7.7 NCE points respectively between pre- and post-testings. At 
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grade one, the largest gain (19,7 NCE points) was observed. At the eighth 
grade level the smallest acceptable positive NCE gain (3.1) can be observed. 
See ^pendix B for the test results by building and funding source. 

Overall in the area of mathematics the standard that ,post-test NCE scores 
will exceed two NfCE units was attained in 7 of 10 (70.0%) and 7 of 11 (63.5%) 
grade levels for basic mathematics skills and advanced mathematics skills 
respectively. The administrative rules that required the monitoring of 
progress in both basic and advanced skills also required "plans of 
improvement" from buildings experiencing aggregate gains of two NCE units or 
less in one or more skill areas ser^/sd. The chart below shows with an •'X" the 
buildings in the area of mathematics (bajic and/or advanced skills) required 
to submit a plan of inprovoivent for 1991-92 school year Chapter 1/Article 3 
results. 
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1991-92 CHAPTER 1/AmCLE 3 BUHDINGS RBQDIRE2) TO SUBMIT 
IVVTEEMATICS PLANS OF IMPROVE^BrT. 



Basic Skills Advanced Skills 

High School 
Arthur Hill 

Saginaw High X X 

Junior High 

Central Jr. X 
North Int. 

South Int. X X 

t'febber Jr, X X 

ElCTientary 

Baillie X X 

Coulter 

Enerson X 
Fuerbringer X 
Nelle Haley 
Handley 

Heavenrich X 

Herig 

Houghton 

Jercrie 

Jones 

Kenpton 

Longfellow 

Longs treet 

J« Locmis 

Merrill Park 

Chester Miller 

John Moore 

Morley 

J. RDUse 

Salina X 
Stone 

Vfebber Ele. X 
Zilwaukee 

Note: X = Aggregate gain two NCE units or less. 

A study of the chart above reveals that ten buildings (one high school, 
three junior highs, and six elenentary schools) need to develcp plans of 
inprovement because their aggregate perfomBnce in basic and/or advanced 
skills was two NCE units or less. 
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Product Datas Reciding Reoowery Pilot 

As stated, the Reading Reoovery Pilot program (a pull-out intervention - 
for 55 pupils in reading in grade one) was started in December, 1991. The 
pilot took place at eight elementary sites* The^ v?ere the following: 
Coulter, Nelle Haley, Locmis, Longfellow, Longstreet, Salina, Ifebber, and 
Heavenrich. 

A group of first grade ccrrpensatory education students were randomly 

sampled from five elementary sites* The sites where students were selected 

for the random sanple included Baillie, Elnerson, Houghton, fiorley, and Rouse# 

The random sample of approximately 26 conpensatory education pupils were 

4 

selected for pre- and post-testing on the Diagnostic Survey • A ccnparison 
group of approxiinately 100 conpensatory education participants were selected 
to be pre- and post-tested on the California Achievement Test (CAT) as another 
corparison group that extended to all first grade conpensatory education 
sites. 

Reading Recovery is based on the premise that early, high^uality help 
has the greatest potential for lasting inpact and for reducing the need for 
continued corrpensatory help. The program is an intensive one-to-one 
intervention program for the poorest readers (lowest 20 paicent) in first- 
grade classroons, as identified by te^.chOL judgment and a Diagnostic Survey ^ 
The primary goals of Reading Recovery are to reduce reading failure through 
early intervention and to help children become independent readers. The 



The Diagnostic Survey is a systematic observation assessment (six 
different assessments in different aspects of reading and writing) used as 
part of the Reading Recovery procedures. A full discussion of its potential 
u'-^s and procedures can be found in Clay, M. M. (1990). The Early Detection 
£ fading Difficulties . Auckland, New Zealand Heinemann Education. 
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program acccnplishes this by: 1) bringing children who are "at risk" of 
reading failure up to the average of their class within a short period of 
time, so that they can profit form ongoing classroom instruction, and 2) 
helping these children, develop a self-iitproving system for continued growth in 
reading, so that additional help is not necessary, 

Reading Recovery supplenents but does not substitute for conventional 
classroom teaching. During daily, 30-minute lessons, teachers who are 
specially trained in Reading Recovery techniques individually tutor these 
faltering readers to help them develop the kinds of strategies that good 
readers use. The pcMer of Reading Recovery is in the framework of the lesson 
itself and in the development of teacher knowledge and problem-solving 
ability. The approach combines the use of related reading and writing 
experiences, close interaction between teacher and child within the lesson, 
and careful selection of materials for reading. In this instructional 
program, the teacher follows and guides the child individually in his or her 
use of reading and writing strategies. The teacher closely assesses and 
monitors progress and nnalces appropriate decisions to accelerate the child's 
program. 

Research to date indicates that Reading Recovery has potential for 
substantially reducing the number of children with reading difficulties. As a 
result of accelerated progress, children typically leave the program within 12 
to 16 veeks and are able to perform at satisfactory levels in reading without 
continued extra help. The sustained success that Reading Recovery achieves 
with the poorest performers in first grade classes runs counter to the 
experience in most remedial education programs. 

Tw3 research questions were the focus o£ conparing results of the Reading 
Recovery Pilot group and comparison groups at non-Reading Recovery sites. 
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Theso questions follow: 

1) How did Reading Recovery children (discontinued and 
not discontinued) and conparison children perform 
at the end of grade one on a variety of Treasures 
of reading ability? 

2) How did Reading Recovery and corparison children 
perform at the end of grade one on a nationally 
norrned standardized test? 

Table 5 below presents the means and standard deviations for the Reading 
Recovery children (including both discontinued and not discontinued pupils) 
and a corparison group of children at non-Reading Recovery Pilot sites. The 
statistics given in Table 5 relate to the six subtests of the Diagnostic 
Survey which are expressed as number right except for text reading which is a 
numerical score and refers to the level of difficulty a child can read with 
90% accuracy or above (see Appendix F for conversion chart). 
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lABLE 5. MEANS AND S1»NDARD EEVDOIONS FOR ALL READING WXXNEBS 
CaiUXEIH AND RANDOM SAMPIf CP FIBST GRMXRS GN SIX 
MEASOBES FROH TBE DIAlGNOSnC SmiEI , 
DGCOIBER AND MAY, 1991-92. 







Reading Recovety 
Children* 




Coitparison 
Children 


Measure 


Ktonth 


N 


Mean 


S.D. 


N 


Mean 


S.D. 


Text 

Reading 

(Max=34) 


Dec. 
May 


48 
48 


2.00 
15.10 


1.38 
7.34 


20 
20 


4.00 
10.65 


3.58 
9.12 


Letter 
Ident, 
{Max=54) 


Dec. 
May 


48 
48 


51.08 
53.06 


2.63 
1.20 


20 
20 


48.10 
50.55 


8.68 
7.25 


Test 
(Max=20) 


Dec. 

May 


48 
48 


5.96 
17.87 


2.80 
3.32 


20 
20 


7.90 
14.10 


6.07 
6.30 


Concepts 
About 
Print 
(Max-24) 


Dec. 
May 


48 
48 


13.29 
20.10 


3.21 
2.77 


20 
20 


12.60 
15.45 


3.35 
3.51 


Ivriting 
Vocabulary 
(10 min. ) 


Dec. 
May 


48 
48 


23.79 
51.46 


10.64 
17.99 


20 
20 


26.45 
33.55 


15.61 
18.37 


Dictation 
(Max=37) 


Dec. 
May 


48 
48 


17.65 
32.83 


7.30 
5.11 


20 
20 


19.45 
26.50 


11.59 
10.13 



*Includes both successfully discontinued and not-discontinued children during 
the first grade year. 
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Highlights frcm Table 5 include the following: 



• Although the Reading Recovery and conparison groups 
had sunilar mean scores for the six subtests assessed 
in Decemberf 1991, the Reading Recovery group 
(including both discontinued anc^ not discontined) 
scored higher on all six measures at the end of the 
school year. 

• Vlien contrasting pre- to post-test average gains the 
largest difference between these gains occurred in 
writing vocabulary with the conparison group gaining 
lA (33.55 - 26.45) raw score points and the Reading 
Recovery group gaining 27,67 (51.46 - 23.79) raw 
score points. Overall on average, the Reading 
Recovery group out gained the corparison group by 
20.57 raw score points on the writing vocabulary 
subtest. 

• Again, when contrasting pre- to post-test average 
gains, the smallest difference between these gains 
occurred in letter identification with the coirparison 
group gaining 2.45 (50.55 - 48.10) raw score points 
and the Reading Recovery group gaining 1.98 (53.06 - 
51.08) raw score points. Overall on average, the 
carparison group out gained the Reading Recovery 
group by 0.47 raw score points on the letter identi- 
fication subtest. 



Table 6 belcw records the Normal Curve E3quivalent (NCE) gain scores for 
the Reading Recovery group, conparison group, and all first grade children 
tested on the reading vocabulary, ccrrprehension, total scores of the 
California Achievement Tests (CAT). 
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TABLE 6. MEAN NOeMAL CURVE ECfJmHWr (NCE) GAIN SCORES FOR GRAEE 1 
READING BSCXK^ERYr OQMPARISGK, MiD DISHRICT-HIOe (SCUFS IN 
READINQ VCOBOlMa, READI!^: OGKFBEHEHSIGMr AND READING 
TCtEAL BASES ON APRnrMAYr 1991 FRB-TESTING AND 
AffilL-MUr, 19fy2 POSlHtBSTING CN CAT 
(SE>RING TO SPRING). 







Normal Curve Equivalents 




Subtest/Group 


Nunber Tested 


Pre-Test 
Mean 
(Spring, 1991) 


Post-Test 
Mean 
(Spring, 1992) 


Mean 

Gain/ 

Loss 


Reading Vocabulary 
Reading Recovery 
Conparison 
District-Wide* 


54 
89 
1,014 


24.6 
22.1 
49.3 


40.0 
42,7 
46.8 


15.4 
20.6 
- 2.5 


Reading Coirprehension 
Reading Recovery 
Conparison 
District-V7ide 


54 
89 
1,014 


35.6 
30.2 
48.1 


38.7 
39.2 
44.8 


3.1 
9.0 
- 3.3 


Reading Total 
Reading Recovery 
Conparison 
District-VJide 


54 
89 
1,014 


26.9 
22.0 
48.6 


37.0 
39.0 
44.2 


10.1 
17.0 
- 4.4 



*Di Strict-wide results included all matched students pre-tested in kindergarten 
during Spring, 1991 and again post-tested in grade one during Spring, 1992. 
This grcxip also included the Reading Recovery and ccnparison groups. 



A review of Table 6 above, reveals the following highlights: 



• \-i\en students were pre-tested with the California 
Achievement Test (CAT), the Reading Recovery group 
was better than the conparison gi'oup by 2.5, 5.4, 
and 4.9 ^3CEs for reading vocabvilary, reading 
ccqprehension, and reading total respectively . 
The district-^ide group was better dian the Reading 
Recovery group by 24.7, 12.5, and 21.7 NCEs respec- 
tively. 

# Both Reading Recovery and conparison group children 
showed positive NCE gain scores from pre- to post- 
testing, rcwever, ccnparison group children out- 
gained Reading Recovery group children by 5.2, 5.9, 
and 6.9 NCEs for reading vocabulary, reading 
coirprehension, and reading total respectively. 



• District-wide children, on the other hand, had minus 

NCE gain scores from pre- to post-testing. The 

district-wide group lost -2.5, -3.3, and -4.4 NCEs 
for reading vocabulary, reading conprehension, and 
reading total respectively. 

Further research plans into the Reading Recovery Pilot calls for 
following this the first Reading Recovery cohort and its conparison group for 
the next four school years. The results will be reported in the Corpensatory 
Education Product Evaluation Report so long as the group size remains above 
15. A second long-term tracking of Reading Recovery students (second Reading 
Recovery cohort) will start in the 1993-94 school year after more Reading 
Recovery teachers are trained and the current partially trained teachers 
oonplete the year long instruction. Again, the second study will track the 
second Reading Recovery cohort for four years after they receive the Reading 
Recovery treatment in 1993-94. 
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SlMfARY AND OGNCLUSIONS 



The Chapter 1 and Article 3 Coirpensatory Education (CE) prograiTB were 
designed to provide direct instructional services in reading and natheiratics 
to sane 2^817 students in grades one through twelve. Tne main intent of the 
CE programs vgere to improve the pupil's reading and/or mathematics 
achievement. Instruction occurred primarily in small group settings outside 
of the regular classroom (pull-out) or push-in (that operated in the regular 
classroan in grades one and two) for CE at the elementary level, and in a 
regular classroan setting with a reduced number of students for CE at the 
secondary level. In addition, the Reading Recovery Pilot program (a pull-out 
intervention for 55 pupils in reading in grade one) was started in December, 
1991. The results of Reading Recovery Pilot presented herein tend to suggest 
that this program has pronise (when you realize the current set of Reading 
Recovery teachers are only half trained) and its long-term effectiveness 
should be tracked for the four additional school years as planned. As noted 
eariler, this is the first year the program changed significantly by focusing 
the evaluation of both Chapter 1 and Article 3 on advanced skills as well as 
basic skills in reading and mathematics. 

The results of the pre- to post-testing of compensatory education 
students by grade indicate the overall greatest gains in reading were made at 
the first grade level, and grades one through three attained the performance 
standard in basic and advanced skills plus grades 9, 10, and 12 in basic 
skills. Mathematics gains were the greatest at grade 3 (basic skills) and 
grade 1 (advanced skills), but that all grades met the standard except grade 4 
(advanced), grades 7, 10, and 12 (basic and advanced). The reader should be 
cautioned not to hold too rrtich confidence in the results of grade 12 since 
they have so few students in this grade (fron 13 to 16). 
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The new evaluation njles that required focusing the evaluation of both 
Chapter 1 and Article 3 on basic and advanced skills also required "plans of 
iirprovement" from buildings experiencing two NCE units or less in one or more 
skill/subject areas across all grades served. For the 1992-93 school year, 20 
and 10 buildings in reading and mathematics respectively will be required to 
submit plans of inprovement in basic and/or advanced skills. The chart below 
shows with an "X" the buildings that are required to submit a plan of 
inprovement in basic and/or advanced skills for reading and/or mathematics. 
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1991-92 (HAPiro 1/ARnCLE 3 BUILDDWS RBQUIRED TO SDBMIT 



READING 



MATHEMATICS 



Basic 
Skills 



Advanced 
Skills 



HIGH SCHOOL 

Arthur Hill 
Saginaw High 

JUNIOR HIGH 

Central Jr, 
North Int- 
South Int. 
Vfebber Jr. 

ELEMENTARY 



X 

X 



X 
X 
X 
X 



Basic Advanced 
Skills Skills 



X 
X 



X 
X 



Bail lie 

Coulter 

Elnerson 

Fuerbringer 

Nelle Haley 

Handley 

Heavenrich 

He rig 

Houghton 

Jerome 

Jones 

Kenpton 

Longfellow 

Longstreet 

J. Loanis 

Merrill Park 

Chester Miller 

John Ptoore 

Morley 

J. Rouse 

Salina 

Stone 

Ifebber Ele* 
Zilwaukee 



X 
X 



X 
X 



X 
X 
X 
X 



X 
X 
X 
X 
X 

X 
X 

X 
X 



X 
X 



X 



X 
X 



Note; X = Aggregate gain two NCE units or less. 
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The 1991-92 corpensatory education delivery system showed decreases frcm 
the previous years in terms of the percentage of grade levels meeting the 
standard. Since the standard increased from nore than zero NCE gain (1990-91) 
to more than tvo NCE gains (1991-92), the percent of grades attaining the 
standard for 1990-91 were recalculated using the standard of more than two NCE 
gain as the measure of a successful grade level attainment. The chart below 
siirmarizes these changes. 

FSXSir OF GRADES ATEMNING STANDARD 



Area 
Basic Reading 
Advanced Reading 
Basic Mathematics 
Advanced Mathematics 



1990-91 vs. 1991-92 

75.0% vs. 54.5% 

58.3% vs. 27.3% 

80.0% vs. 70.0% 

72.7% vs. 63.6% 



Change Status 
Etecrease 
Decrease 
Decrease 
Decrease 



Overall, CE results present a picture of a strong program (especially at 
the elementary level) in both reading and mathematics. The fourth grade and 
above reading program and the tenth/twslf th grade mathematics program appear 
especially weak. 

As mentioned earlier, a process evaluation report was conrpleted this year 
and can be found in Appendix E. The findings fran that report as well as 
those cited above were used in helping develop the reccmmendations that 
follow. 
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The recomnendations that follow are based on this year's process and 
product evaluations plus the recently corpleted 1987-1990 sustained effects 
study and are intended to help bring about Chapter 1/Article 3 program 
irtproveroents in the following school year. These recomnoendations take nothing 
away fron a program that continues to show positive results especially at the 
elementary level, on an annual basis. This year being no expect ion. 

The recomnended ideas and techniques offered below stan from a perceived 
problem and are just one of many ways to ijfprove the performance of the 
program. As solutions are sought for optimum program operations, a dialogue/ 
discussion should be undertaken to determine the best and most workable way to 
solve the perceived problem. The staff and evaluator should be brought into 
these discussions so that all involved feel part of the proposed new operation 
of the program. 



• The sustained effects study found that most exiting 
CE program participants in reading and mathe- 
matics experienced a drop off of achievement during 
the sustained effects period (-3.3 and -5.8 NCEs 
respectively). These results strongly indicate that 
students should be grandfathered if they score above 
the selection cut score after one or more years of 
Chapter 1 service. Present Chapter 1 legislation 
allcws for a two-year grandfathering period and 
hopefully in the case of most students that would be 
an adequate length of additional service to help 
promote future positive academic achievement. 

• Reduce variations in the program between txjildinq 
sites by having the director and corpensatory 
education staff analyze the building results pre- 
sented in Appendix B . This analysis process should 
also involve building leaders and school improvement 
teams. Hopefully, a plan can be formulated to 
reduce (or control) these variations in program 
irrpact. 
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Pupil Service Team (PST) and Success activities need 
to have more definition and less variation in their 
operation. These Chapter I/Article 3 activities 
could be enhanced by doing the following: 



— One person should be assigned to oversee 
PST and Success activities. Such a person 
would be in a better position to bring 
consistency to PST/Success. This consis- 
tency of (^ration would include the 
following: Chapter 1/Article 3 eligibility 
verification processes, provide corminica- 
tion between and within organization units 
involved with PST/Success and inspire, 
where lacking, cornnitnient to PST/Success 
outreach efforts. 

— A specific definition of what constitutes 
a corrpleted plan should be developed, with 
attention given to whether corpleted refers 
solely to fact-finding, discussion, and 
prescription or if treatment and case 
reviews are included. 

— Volunteer roles, e.g., how the roles are 
determined and hew volunteers are screened 
for abilities, should be specified. As 
well, a listing of all study center sites 
(both on and off campus) should be cort- 
pleted. 

— An insGrvicBr or set of inservices, should 
be developed to fully infom personnel 
(district-wide) of the scope, nature, and 
inportance of the PST/Success processes. 

— The PST/Success process should not be 
limited to just those students recaimended 
by a teacher. All Ch^ter 1/Article 3 
students with two (and perhaps one) years 
NCE gain or loss status should have action 
plans developed for them. 
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APPENDIX A 

1991-92 OOUNT OP PRDGKAN PAFTICIBANIS* 
PRDGRflM: Total Chapter 1 



Building 


K 


1 


2 


3 


4 


5 


6 


Total 


E. Baillie 


0 


16 


13 


16 


27 


17 


7 


96 


Coulter 


0 


23 


11 


8 


17 


3 


10 


72 


Elnerson 


0 


24 


41 


39 


20 


12 


24 


160 


Fuerbringer 


0 


8 


11 


8 


4 


5 


2 


38 


N. Haley 


0 


25 


13 


16 


26 


22 


14 


116 


Handley 


0 


0 


0 


0 


0 


0 


0 


0 


Heavenrich 


0 


28 


34 


20 


26 


30 


17 


155 


Herig 


0 


20 


12 


16 


16 


9 


5 


78 


Houghton 


• 0 


10 


8 


14 


11 


9 


6 


58 


Jerome 


0 


11 


18 


7 


6 


10 


10 


62 


Jones 


0 


7 


11 


12 


14 


6 


15 


65 


Kotpton 


0 


0 


0 


0 


0 


0 


0 


0 


Longfellow 


0 


34 


33 


25 


16 


16 


30 


154 


Longs tree t 


0 


19 


18 


13 


7 


7 


6 


70 


J. Loomis 


0 


14 


32 


29 


25 


10 


19 


129 


M. Park 


0 


18 


20 


20 


19 


12 


16 


105 


C. Miller 


0 


14 


9 


7 


5 


7 


8 


50 


J. Moore 


0 


13 


10 


12 


14 


8 


5 


62 


Morley 


0 


24 


22 


18 


14 


17 


13 


108 


J. Rouse 


0 


15 


19 


9 


6 


14 


10 


73 


Salina 


0 


15 


9 


11 


5 


15 


11 


66 


Stone 


0 


13 


16 


22 


14 


17 


12 


94 


Wfebber Elem. 


0 


35 


22 


36 


16 


25 


26 


160 


Zilwaukee 


0 


1 


6 


5 


7 


8 


5 


32 


TOTAL 


0 


387 


388 


363 


315 


279 


271 


2,003 



*Count as of March 18, 1992 corrputer run that included all participants 

28 36 



APPENDIX A 
OCUNT OF PROGRAM PARTICIFANIS* 



PHDGRflM: Total Chapter 1 



Building 


_7 


_8 


_9 


Total 


Central Junior 


95 


63 


52 


210 


North Intecnediate 


19 


43 


60 


122 


South Interned iate 


0 


0 


0 


0 


Vfebber Junior 


79 


97 


60 


236 


TOIAL 


193 


203 


172 


568 



*Count as of March 18, 1992 conputer run that included all 
participants • 



29 37 



APPENDIX A 
1991-92 GCUir OF PROGRAM PABnCIPANTS* 

PROGRAM: Total Chapter 1 



Building 


10 


11 


12 


Total 


Arthur Hill 


0 


0 


0 


0 


Saginaw High 


58 


0 


38 


96 


TOTAL 


58 


0 


38 


96 



*Count as of March 18, 1992 ccnputer run that included all 
participants. 
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APPENDIX A 

1991-92 COUNT CP PROGRflM PARTICIPANTS* 
PHOGRflM: Total Article 3 



" Building 


_K 


_1 


";_2 


_i 


_4" 


"_5 


_6 


Total 


E. Baillie 


0 


14 


1 


16 


27 


16 


0 


74 


Coulter 


0 


22 


1 


1 


17 


0 


10 


51 


Einerson 


0 


21 


40 


4 


20 


1 


4 


90 


F\ierbringer 


0 


0 


0 


8 


1 


5 


2 


16 


N. Haley 


0 


24 


13 


15 


26 


2 


0 


80 


Handley 


0 


0 


0 


0 


0 


0 


0 


0 


Heavenrich 


0 


0 


32 


20 


24 


29 


1 


106 


Herig 


0 


19 


1 


16 


15 


1 


0 


52 


Houghton 


0 


3 


0 


12 


0 


9 


0 


24 


Jercme 


0 


0 


18 


0 


6 


11 


11 


46 


Jones 


0 


0 


1 


12 


1 


6 


15 


35 


Kenpton 


0 


7 


3 


7 


7 


9 


6 


39 


Longfellcw 


0 


2 


31 


23 


16 


16 


2 


90 


Longs treet 


0 


17 


1 


13 


7 


7 


6 


51 


J. Loomis 


0 


1 


31 


2 


22 


9 


19 


84 


M. Park 


0 


0 


20 


20 


0 


12 


16 


68 


C. Miller 


0 


0 


0 


7 


5 


0 


8 


20 


J. Moore 


0 


13 


0 


12 


14 


1 


0 


40 


Morley 


0 


0 


22 


18 


13 


1 


13 


67 


J. Rouse 


0 


12 


1 


9 


1 


14 


10 


47 


Salina 


0 


0 


8 


0 


2 


15 


11 


36 


Stone 


0 


13 


0 


22 


14 


15 


0 


64 


l-febber Elem. 


0 


2 


22 


37 


0 


25 


25 


111 


Zilwaukee 


0 


0 


6 


5 


7 


8 


5 


31 


TOTAL 


0 


170 


252 


279 


245 


212 


164 


1,322 



*Count of March 18, 1992 coiijuter run that included all participants. 

31 39 



APPENDIX A 
1991-92 OCXJNT OF PROGRAM PARTICIPANTS* 

PRDCaiflM: Total Article 3 



Building _Z __9 Total 

Central Junior 0 56 40 96 

North Intermediate 1 43 60 104 

South Intermediate 23 37 40 100 

Vfebber Junior 0 96 59 155 

TOTAL 24 232 199 455 



*Count as of March 18, 1992 conputer run tnat included all 
participants. 
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APPENDIX A 
1991-92 eOWr OP-FBOOtAK PABTICIBMIIS* - 



F60Q»H: Total Article 3 



Building 


10 


11 


12 


Total 


Arthur Hill 


0 


0 


0 


0 


Saginaw High 


18 


0 


0 


18 


TOTAL 


18 


0 


0 


18 



*Count as of March 18, 1992 conputer run that included all 
participants. 



33 41 



APPENDIX A 

1991-92 COUNT OF PROGRAM PABTICIEftNTS* 

PEDGRftM: Total Caniiensatory Education 



Building 


K 


1 


2 


3 


4 


5 


6 


Total 


E. Baillie 


0 


16 


13 


16 


27 


17 


7 


96 


Coulter 


0 


23 


11 


8 


17 


3 


10 


72 


Eraerson 


0 


24 


41 


39 


20 


12 


24 


160 


Fuerbringer 


0 


8 


11 


8 


4 


5 


2 


38 


N. Haley 


0 


25 


13 


16 


26 


22 


14 


116 


Hand ley 


0 


0 


0 


0 


0 


0 


0 


0 


Heavenrich 


0 


28 


34 


20 


26 


30 


17 


155 


Herig 


0 


20 


12 


16 


16 


9 


5 


78 


Houghton 


0 


10 


8 


14 


11 


9 


6 


58 


Jercine 


0 


11 


18 


7 


6 


11 


11 


64 


Jones 


0 


7 


11 


12 


14 


6 


15 


65 


Kertpton 


0 


7 


3 


7 


7 


9 


6 


39 


Longfellcw 


0 


34 


33 


25 


16 


16 


30 


154 


Longs treet 


0 


19 


18 


13 


7 


7 


6 


70 


J. Loomis 


0 


14 


32 


29 


25 


10 


19 


129 


M. Park 


0 


18 


20 


20 


19 


12 


16 


105 


C. Miller 


0 


14 


9 


7 


5 


7 


8 


50 


J. Moore 


0 


13 


10 


12 


14 


8 


5 


62 


Morley 


0 


24 


22 


18 


14 


17 


13 


108 


J. Etouse 


0 


15 


19 


9 


6 


14 


10 


73 


Salina 


0 


15 


9 


11 


5 


15 


11 


66 


Stone 


0 


13 


16 


22 


14 


17 


12 


94 


Vfebber Elem. 


0 


35 


22 


37 


16 


25 


26 


161 


Zilwaukee 


0 


1 


6 


5 


7 


8 


5 


32 


TOTAL 


0 


394 


391 


371 


322 


289 


278 


2,045 



*Count of March 18, 1992 conputer run that included all participants. 



APPENDIX A 
1991-92 GODWr OF raOGRAM PAKEICIPAIIIS* 

PROGRAM: Total Compensatory Education 



Building 


_2 


_8 


9 


Itital 


Central Junior 


95 


63 


52 


210 


North Intermediate 


20 


43 


60 


123 


South Intermediate 


23 


37 


40 


100 


Vfebber Junior 


79 


97 


60 


236 


TOTAL 


217 


240 


212 


669 


*Count as of March 18, 
participants. 
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TABI£ B.5. MEAN NCFMAL CURVE GQUIVAiaiT GAIN BY BUILDING AND GRADE FOR ALL 7-9 
GBKPTBR 1 FUPIUS IN TOXAL READING (BASIC SKILLS) AND READING OCHFBBiraSICN 
(ADUMOD SKILLS) BASED CN AFRILH4AY, 1991 PRE-^IESTING AND APRIL-MAY, 1992 
KJBT-TBSmG GN CAT (SPRING TO SPRING). 







Grade 7 






Grade 


8 






Grade 9 




Subject/ 




Normal Curve 






Normal Curve 






Normal Curve 




School 




Equivalents 






Equivalents 






Equivalents 












Mean 








Mean 








Mean 




Nunber 


Pre 


POGt 


Gain/ 


Nunber Pre 


Post 


Gain/ 


Nuniber Pre 


Post 


Gain/ 




Ties ted 


Mean 


Mean 


Loss 


Tested Mean 


Mean 


Lobs 


Tested Mean 


Mean 


Loss 


TOTAL 


























READING 


























Central 


79 


29.3 


24.2 


-5.1 


49 


26.6 


26.9 


0.3 


37 


28.5 


32.1 


3.6 


North 


13 


30.6 


32.6 


2.0 


27 


24.9 


27.3 


2.4 


38 


28.2 


33.4 


5.2 


South 


0 








0 








0 








Vtebber 


61 


30.6 


24.8 


-5.8 


82 


27.1 


26.2 


-0.9 


47 


29.7 


31.0 


1.3 


System 


153 


29.9 


25.2 


-4.7 


158 


26.6 


26.6 


0.0 


122 


28.9 


32.1 


3.2 


ISACONG 


























GCMPlRHffiSICN 


























Central 


79 


34.2 


31.0 


-3.2 


49 


32.2 


33.8 


1.6 


37 


33.2 


32.7 


-0.5 


North 


13 


35.2 


33.3 


-1.9 


27 


27.0 


29.6 


2.6 


38 


33.2 


33.6 


0.4 


South 


0 








0 








0 








Vfebber 


61 


34.3 


27.2 


-7.1 


a2 


29.9 


29.1 


-0.8 


47 


33.0 


29.4 


-3.6 


System 


153 


34.3 


29.7 


-4.6 


158 


30.1 


30.7 


0.6 


122 


33.1 


31.7 


-1.4 
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TABE£ B.6. MEAN NORmL CURVE QQDI\^LEMT GAIN BY BODYING AND GRADE FOR ALL 7-9 
CBAFIER 1 PUPILS IN lOEAL MATHEMATICS (BASIC SKILLS) AND MAOBEMATICS OXOPIS 
AND AFFUCmONS (AEKANCED SKUIS) BASED CN APRIL-MAY, 1991 FRE-TESTIMS 
AM) APRIL-MAY, 1992 P061VTESTING CN CAT (SPRING TO SPRING). 







Grade 7 






Grade 


8 






Grade 9 




Subject/ 




Normal Curve 






Noonal Curve 






Normal 


Curve 




School 




Equivalents 






Equivalents 






Equivalents 












Nean 








Mean 








Mean 




ill 1 


Pre 


Post 


Gauv 


Number Pre 


Post 


(iaiiv 


Nunber Pie 


Post 


uaiiv 




"tested 


Mean 


Mean 


Loss 


Tested Mean 


Mean 


Loss 


Tested Mean 


Mean 


Loss 


jXTlAL 


























MATnrllftTiCo 


























Central 


18 


30.2 


28.2 


-2.0 


17 


26.5 


26.7 


0.2 


17 


29.7 


32.3 


2.6 


North 


5 


28.6 


26.8 


-1.8 


16 


25.9 


35.0 


9.1 


13 


30.0 


35.0 


5.0 


South 


0 








0 








0 








Vfebber 


33 


29.2 


24.3 


-4.9 


49 


26.4 


31.1 


4.7 


26 


25.7 


30.1 


4.4 


SystCT 


56 


29.5 


25.8 


-3.7 


82 


26.3 


30.9 


4.6 


56 


27.9 


31.9 


4.0 


CCNCEFIS AND 


























APPLICATIONS 


























Central 


18 


31.4 


28.8 


-2.6 


17 


26.5 


30.1 


3.6 


17 


31.1 


36.7 


5.6 


North 


5 


33.8 


35.4 


1.6 


16 


28.6 


38.3 


9.6 


13 


34.9 


38.6 


3.7 


South 


0 








0 








0 








Vfebber 


33 


31.2 


26.5 


-4.7 


49 


30.2 


32.5 


2.3 


26 


26.9 


31.7 


4.8 


System 


56 


31.5 


28.0 


-3.5 


82 


29.1 


33.1 


4.0 


56 


30.0 


34.8 


4.8 
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lABLB B.7. MEAN NCXMNL CURVE BJUmmtT GMS BY BUILDING AND GRADE FOR ALL 10-12 
CHAPIER 1 PUPILS IN IDEAL READING (BASIC SKILLS) AND READING CCHPRBSNSICN 
(AEMttCQ) SKILLS) BASED CN APRIL-MAY, 1991 FRE-OESTDIG AND APRIL-MMT, 1992 
POSIVIGSnNG ON CAT (SPRING TO SPKDIG). 



Subject/ 
School 


Grade 10 

Normal Curve 
Bquivalents 

Mean 

Nunber Pre Post Gain/ 
Tested Mean Mean Loss 


Grade 11 

Nonnal Curve 
Equivalents 

Mean 

Number Pre Post Gain/ 
Tested Mean Mean Loss 


Grade 12 

Normal Curve 
Equivalents 

Mean 

Nmrter Pre Post Gain/ 
Tested Mean Mean Loss 


TOTAL 
READING 

Arthur Hill 
Saginaw Hicfi 

System 


36 23.6 25*8 2.2 
36 23.6 25.8 2.2 


0 

0 ~ — 


16 22.2 25.6 3.4 
16 22.2 25.6 3.4 


READING 
CQMPREHEMSia 

Arthur Hill 
Saginaw High 

System 


I 

0 — ~ — 
36 30.9 30*5 0.0 

36 30.9 30.9 0.0 




16 28.5 30.0 1.5 
16 23.5 30.0 1.5 



54 

43 

ERJC 



APPENDIX B 



TABLB B.8. MEAN NORMAL CURVE EQUIVMOir GAIN BY BUIIJ3ING AND GRADE FOR ALL 10-12 
CBAPTCR 1 PUPILS IN TOTKL MATHEMATICS (BASIC SKILLS) AND MATHE3«nCS CCNCEPTS 
AND APPLICATIGNS (ADVMKXD SKILI5) BASES GN APRIL-MAy, 1991 PBE-TESTTOG 
AND APRIL-MAY, 1992 POST^IESTING ON CAT (^RINS TO SFRINS). 



ScAooi 


Grade 10 
Equivalents 

Mean 

Number Pre Post Gain/ 
Tfested Mean Mean Logs 


Grade 11 

nujLiiioJ. vxu.v^ 
Equivalents 

Mean 

Niinber Pre Post Gain/ 
Tested Mean Mean Loss 


Grade 12 

nonnax lAirve 
Equivalents 

Mean 

Number Pre Post Gain/ 
Tested Mean Mean Logs 


TOTAL 
READING 

Arthur Hill 
Saginaw High 

Syaton 


0 

23 30.3 30.6 0.3 
23 30.3 30.6 0.3 




13 25.9 19.6 -6.3 
13 25.9 19.6 -6.3 


READIMS 
OQMPREliElGia 

Arthur Hill 
Saginaw High 

System 


1 

23 33.0 31.1 -1.9 
23 33.0 31.1 -1.9 




13 28.3 20.6 -7.7 
13 28.3 20.6 -7.7 
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f iaz 
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feel 
1 |3 


7 38.7 39.1 0.4 
3 31.6 29.6 - 2.0 
1 34.0 32.0 - 2.0 
0 

0 

0 

9 3i.B 33.4 1.4 
13 36.0 32.7 - 3.3 
6 38.1 30.3 0.2 

1 34.0 33.0 - 1.0 
5 41.8 41.4 - 0.4 

17 32.5 28.7 - 3.8 

10 32.3 34.9 2.6 
S 36.2 35.8 . 0.4 

11 31.2 34.7 3.5 
9 40.5 38.1 . 2.4 

11 41.0 40.9 - 0.1 

21 37.4 38.9 1.5 
4 38.2 43.7 5.5 
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0 - 

13 31.1 39.8 8.7 

1 19.0 19.0 0 0 
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1 24.0 31.0 7.0 
23 26.2 27.6 3.4 

14 29.6 35.1 5.5 
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15 25.2 34.0 8.8 

1 34.0 44.0 10.0 
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TABLE B.13. MEAN NCMIAL CURVE BQUIVALQir GMN BY BDIIDING PND GRADE FCR ALL 7-9 
ARnC££ 3 EUPILS IN TQOAL READINS (BASIC SKILIfi) AID HEADIN5 GQMPREBE2ISIGN 
(ADVANCED SKniS) BASO) GN AFIOXr-MAY, 1991 FI^IXSTING AW) APRIL-HAY, 1992 
PQSIVIESTING ON CKT (SPRING TO SPRING). 







Grade 7 






Grade 8 






Grade 9 




Subject/ 




Normal Curve 






Normal Curve 






Nocinal Curve 




School 




Elquivalents 






Equivalents 






Bcpiivalents 












Mean 








Mean 








Mean 






Pre 


Post 


OnJuv 


Number Pre 


Post 


Rain/ 

VJuXii/ 


C^mnber Pre 


Post 






lbs ted 


m.M 

Mean 


nean 


L36S 


Tested Mean 


Mean 


loss 


Tested Mean 


Mean 


loss 






















































Central 


0 








46 


25.7 


26.2 


0.5 


30 


25.3 


29.3 


3.9 


North 


1 


37.0 


41.0 


4.0 


27 


24.9 


27.3 


2.4 


38 


28.2 


33.4 


5.2 


South 


17 


32.7 


34.9 


2.1 


24 


30.9 


30.1 


-0.7 


26 


32.9 


32.8 


-0.1 


Ifebber 


0 








82 


27.1 


26.2 


-0.8 


47 


29.7 


31.0 


1.2 


System 


18 


33.0 


35.2 


2.2 


179 


26.9 


26.9 


0.0 


141 


28.9 


31.6 


2.7 


READING 


























COMPREHESION 


























Central 


0 








46 


31.7 


33.5 


1.8 


30 


30.4 


29.2 


-1.2 


^3orth 


1 


40.0 


44.0 


4.0 


27 


27.0 


29.6 


2.6 


38 


33.2 


33.6 


0.4 


South 


17 


37.8 


37.4 


-0.4 


24 


35.8 


34.1 


-1.7 


26 


37.7 


32.1 


-5.6 


Vfebber 


0 








82 


29.9 


29.1 


-0.8 


47 


33.0 


29.4 


-3.6 


System 


18 


37.9 


37.7 


-0.2 


179 


30.7 


31.0 


0.3 


141 


33.4 


31.0 


-2.4 
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TABLE B.14. IffiAN NOFMAL CORVE BQDIVALENT GAIN BY BUIIJ)ING AND GRAEE EC« ALL 7-9 
ARTICLB 3 FUPIIS IN TOHiL tVOBBWaiCS (BASIC SKILIS) AMD HAIBB1AZICS OCNCEPIS 
AND APPLICXnCNS (MM^NCED SKILLS) BASED ON ARRIL-HA7r 1991 FRE-TESTINS 
AND AflOL-MAX, 1992 FOSI^TESTING GN CKT (SFRIN5 TO SPRINB). 







Grade 7 






Grade 8 






Grade 9 




Subject/ 




Normal Curve 






Normal Curve 






Normal Curve 




School 




Bguivalents 






Bquival^.ts 






Bguivaler^ts 












Mean 








Mean 








Nean 






Pre 


Post 


Gain/ 


Nurber Pre 


Post 


Gain/ 


Number Pre 


Post 


Gain/ 




Tested 


nean 


nean 


Loss 


Tested Nean 


necul 


Loss 


Tested Meein 


nBGUl 


liSSS 


TUIAL 


























NAHHHiKnCS 


























Central 


0 








13 


23.9 


24.9 


1.0 


14 


27.2 


31.0 


3.8 


North 


0 








16 


25.9 


35.0 


9.1 


13 


30.0 


35.0 


5.0 


South 


7 


37.4 


38.8 


1.4 


17 


31.7 


33.5 


1.8 


20 


32.4 


34.1 


1.7 


Vfebber 


0 








49 


26.4 


31.1 


4.6 


26 


25.7 


30.1 


4.4 


Systan 


7 


37.4 


38.8 


1.4 


97 


26.9 


31.2 


4.3 


73 


28.6 


32.2 


3.6 


CCNCEPTS AND 


























APPLICmCNS 


























Central 


0 








15 


24.0 


28.1 


4.1 


14 


29.2 


34.8 


5.6 


North 


0 








16 


28.6 


38.3 


9.7 


13 


34.9 


38.6 


3.7 


South 


7 


47.5 


45.1 


-2.4 


17 


35.7 


35.4 


-0.3 


20 


38.5 


36.7 


-1.8 


Ifebber 


0 








49 


30.2 


32.5 


2.3 


26 


26.9 


31.7 


4.8 


System 


7 


47.5 


45.1 


-2.4 


97 


29.9 


33.3 


3.4 


73 


31.9 


34.9 


3.0 



ERIC 



65 

50 



APPSIDU C 



CHECKUST FOR MIDDLE SCHOOL PRINCPALS 
(Conditions Undtr Which tht HOTS Program is Efftctivt for Oupttr 1 and LO Students) 



HOTS is a general thinking skills program dtsignsd primarily for Chapter I and mildly impaired 
Learning Disabled students in Grades 5-9. thinking skills art designed to also enhance social in- 
teraction and basic skills. HOTS students are currently out*perf6rming national averages for basic skiU 
gains in reading and math, and the program has been validated by the National Diffusion Net%vork. 

HOTS represents a new approach to compensatoiy education. Instead of reteaching the infcrmation the 
students did not previously learn, HOTS provides the types of thinking skills that students need to be 
able to learn content the first time it is uught in the classroom. Producing basic skill gains, however, 
requires implementing the program in accordance %vith the ncommcndations that follow. 

1. HOTS rcquim a very good teacher. A weak teacheriimply cannot be successful. The 
pedagogical techniques are very sophisticated. The ideal teacher is someone who is very 
bright, energetic flexible yet organized, and who above all toves to get kids to talk. 

2. HOnrS requim a good overaU school improvement effect in the regular classroom. HCTSis 
designed to help a good* or improving, school get better. HOTS should not be implemented 
in a school with a weak staff, or where extensive school improvement has not already 
taken place Since HOTS does not teach contents if the needed content is not covered in the 
regular Hisses, basic skills scores will not go up. This means high time-on-task* and 
qtaality direct instruction each day in reading and math activities aligned with test 
objectives; 

3. Proper scheduling. The HOTS program is designed to substihite for, and replace , the 
remidial activities in the school. It needs a minimum of 35 minutes of instruction a day, 4 
days a week« on an ongoing basis for 1 i-^l years. This can be done either as a puUout or as 
a separate course. Schools that want to raise math scores can optionally use the fifth day, 
or 10-15 minutes at the end of eadi period, for computerized math drill and practice* 

Students should ideally be kept in the program for \i^2 ymt% even if they test out at the 
end of the first year. This extra service is legal and helpe students automate their new 
problem solving skiUa. FbH and second year HOTS students should be in separate sections. 

Students shoukl be put into HOTS at the lowest grade level in the school (or when they 
first arrive). HOTS can be Implemented either with a limited number of students, or as a 
schoot-wide model serving all needy shidents at the towest grade leveL 

A teachar can handle up to about 10 students at a time with 9 Apple II computers. Ateacher 
and aide can handle up to about 16 students at a dme with 13-15 computers.* Other pupil- 
teacher ratios wiUi various combinations of personnel can be considersd. HOTS project staff 
will assist in identifying other possible combinadona. 

* (It's possible to do the program in the first year with a few less computers, but only for a 
year.) 

4. Quality^ claseroom instntctlon available to HOTS studenla. It is critical that HOTS 
students get good content instnictton in reading and math in their regular cissses. 
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5. Proptfbttdgtting. Costi indude a) puniiisingtlvi Mcded equipment ftoml(X^ 

and b) tniiung ax^l support costt. The training and support costs per school are as follows: 

NymbgofaMricpttaeptd Vptpg 22:92. More than as 

First year • $750 $900 $1100 

Second year 300 400 600 

Thereafter SO 50 100 

* Includes the support fee for the school and training one HOTS teacher and 
aide Each additional HOTS teacher adds $450 to the first year costs. (No 
added cost the jiecond year). 

The support fee includes the curriculum, phone support, the HOTSTUFF 
ne%vsle:ter, videotapes* and updates for as long as you use the prognun. 

6. General support by the prladpaL There are a number of general leadership activities that 
increase ttie effectiveness of the program. The most important leadership activity is to 
implemsni: and monitor a good overall sdHXsleffectiveiicss program^ It is also important to 
support ttie HC3TS teacher who wtU have to %vork very hani particulariy the first year 
whm the curriculum and techniques are unfamiliar. Additional support needs include: 

a) HGT5 linkage activities a>nsist of HC3TS students writing eight question 

afound a block of content every three weeks. Ihese questions and answers are then 
Itoug^t to the HOTS lab and entered into the computer to make games and quizzes 
^Msed OA the content Content teachers interested in working with the students on their 
writing of the questions in their class should be identified and encouraged to work with 
the HOTS students. 



b) Schedule presentations about HOTS for the entire staff early in the school year. This 
indudesa 15 minute video overview of theptogranvand a li~2 hour workshop to 
train content ares teachers on how to help students write questions. The latter should 
be conducted ivithin the first three months by the HOTS teacher. 

c) Support public display of the HOTS studentiT prowess. 

7. Evaluatiiig HOTS InstntctlQii. DO NOT USE EQ EVALUATION TECHNIQUES. HOTS 
Icseone an different The best measure of the HGT5 teacher's effectiveneae is the number of 
complele answen he/she obtains from students— as opposed lo one word answeis— without 
giving obvkHishintaL The more one- word anaweis or hinti^ the weaker the lesson* There 
shouki be Uttle talk by the taecher , and a lot by the students^ 

DO NOT WORRY IF EARLY IN A UNIT STUDENTS SEEM CONFUSED ABOUT HOW 
TOPROCEED. Leenung to use textual informatkm to deal with uncertainty is one of the 
key skills that HOTS develops. The students will be successful by tte end of the unit 

Feel free to contact Dr. Stanley Pogrow if you have further questions. Dr. Pogrow can be reached at: 
University of Arizons, College of Education. Tucson A2 85721 or at (602) 621*1305. 
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1989-90 BASIC APPLICATION 

iPPEHMID „.„„ 

J. PROGRAM DESCRIPTION 

Check only ONE. A separate page must oe corrpieted for eacn type of servce. 

a«CtC ~ SICONOAMV RlAOlNO 

' iLEMIMTAev «CAOlNa ^ SICONOAMV ¥ATM 

] iLCMCMTAevMATM 'Ic! OTHtw (Sm«i»v) Home-'gchOQl Aide s 



iUILOINOS SIRViO: 

See List of eligible schools on page 2, Item A-3 



QRAOI LiViLS SSavCO 

L-12 



OtlCRlVTiON OP CHAPTtR i SCRVICCS (Mutt ineiuo tctlviilta U imfrova ttttia an^ mora a«vanaai iKiiiai: 

Chapter 1 Home/School Aides will assist the: — ■ pg,iOgt 
building principal and Chapter 1 staff in tSS, 
accounting and monitoring of Chapter 1 j cuaaroom 

students attendance and academic progress. ~^ ^aviacamant ciaaa 

Activities will include: regularly schedule3^ 

home contacts, observation and notation '-23 Qtnt^UMa.ry) Home-Schoo l 

of problems occurring in the home, assisting iti fAai 

in the planning and organization of parent-teacher 

meetings* and maintenance of attendance records for Chapter 1 

students • 



Aid 



»UM POn eOOROlNATlON WITH fflOULAM iNtTKUCTtONAL MOORAli: 



The Chapter 1 Home/School Aides will work with both Chapter 1 
and regular teachers to provide information and assistance in 
working with the parents of Chapter 1 students. Key factors in 
academic success such as attendence and problems occurring in 
the home will be monitored and this information will be shared 
with the building staff. 



AVIHAai WllKLr TIMI lACH CMIUO RlCllViS CMAfTIR 1 SIRVICIS: 



CHA^TiH 1 tTAPP fOU TMIt COMPONIMT: 

at. 

T«Mh«r« 

ZE ».M»«f..ti«Mi. Home/School Aides 



ERIC 
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J. PROGRAM olscmmON 

C^tckon^eONC AiipMl«pagtmuiD«Qoaviittdfor«acntyp9o<s«fWt« 

13 ^^^^ C ^CCOMOAftY AMOOiC 

!~! ILMiMTAJIt KiAOlM 01 ttCOMOAAT MTM 

•~ limtMriaT MATH ^2 oyx«(i— #iw ?artne rnvoLymtnc/rralnLrrg 



iwaomas IMVIO: sc« Use of cUglbU bulUlngt on 



4«AM IIVK« imvIO: 

1-12 



oitesirrtoM Of cmmtik i tii vices <iimi ihmmm miivmim i« mm mw mm m imm HTumo Miii«|t 

P4r«ne involv«m«ne and eralnlnt aeeivltlcs will 
b« conducccd on dltcrlce«vld«i cluaccri and 
individual school Uvslf. Opporeuniclca will h% 
provided for r«iular osecingt Co fomulaca 
partncal inpuc inco ch« prograa. Th« Chapccr I 
ParsRC Coordinacor v*lll develop prograst. 
a/;civririef, and procedures chat supporc che 
efforts of parents co work wich cheir children 

in Che hoM to attain che instructional objectives of the prograa. 
addition, che Chapter I Parent Coordinator will provide training co 
parents, teachers, and principals co help build a partnership between 
home and school. 




PUN ^oe coos04MaTidii mtfu egouuui iNersuetioiuL PNoasaMc 



The Chapee? I Parent Coordinator will work vrich both Chapter I and regular 
ceaehers co provide tralnlAg to the staff on che Chapter I parent 
involveMAt tequlreMiiCa and actlvlclea designed to build a stronger bond 
and partnership between the hose and che school. Activities will include 
inforvadon on how parents and the school can work together» opportunltlea 
wichltt the Chapter I and regular school prograa for parents to becoaa 
involved, and specific learning activities parents can uaa with th^lr 
children at hoM* 



aviaaaa wwuy tiaa sacm cmlo agcgivas cka^tix i sgavicgSt 



CHaPTsa 1 staff ron mM coMMNiNri 

Ts u Bite 

^swsrsMMHsiii/Alde; 

- ntii^i^^k^i Parent Coordinator 
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J. PROaHAM OISCMIPTION 

Ch«cH onfy ONft A s#pM« pagi mu« M cofrvMcd for tadi rypt ol saivct . 

~| tLtHtMTAIIV ilAOlM ICeOMOAJI? MATH 



•uibomai iiAvco: jet list of ellgiblt buildings on 



aflAOt W&VtLI ItiVIO 



In mithemttlcs, various in$ervlct sessions at ^uhom 

different grade levels (1-6) will be conducted i— i , . 

focusing on meth manlpulatl ves. Teachers In ■h«j*' ct •••r*^- 

grades 1-6 will receive inservlce in tne area ao»iM««9MciM« 

of reading. Teachers In grades 7-9 will receive r— r 

Infonnttlon and strategies related to the ^ ^-^^ 

Thinking Skills Program, ft au mtt <ww 



PUN POM eoeeoiMATtoiv wrm aeMue (Mtreucnciuw »eoeea«i 

In mathemetlcs. Chapter I teachers and classroom teachers will Instruct 
students together In tht classroom at grades 1-6 on a voluntary basis. 
As a result of the training received (In both subject areas). Chapter I 
and classroooi teachers will Instrtict students using the same infomatlon, 
strategies and materials. Teachers will bt surveyed after the Inservlce 
to detemint the need for follow-up by one of the trainers. Teacher con- 
ferences will be provided for Chapter I, Language Arts, Hathematlcs, and 
teachers to coordinate the new thinking skills strategies In the content 
area with tht reewdtel Instruction. 



AveiiAec veasiiT TtM eaeii CMiS iieiim eMame 1 sestneesi 



etiaeteii 1 eraiP PM nee eoiMneMTi 



Hm$mm 

^ iu b i eee A P'e e C eePd < e e< eii ~ 



TTD — _ LO- 



SS 
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J. PIIOQIIAM OtSCJWPTlOM 

cntck only ONf. A s«pamt pagt mutf bi OQfnpi«(«d for ticti typt c( Mfvic«. 

I I PilK Q IICOHOAaf MA0IM« 

n lUIHIHTftlf «IAQIN4 Q SICOMOAflt MATH 

□ IIIMIMTAJIV MATH ^ QTHiM (t#M4ly» Stttd^Bt A<«tltAttCt TtA« 



lUILOlNOt f IRVIQi 

Sm IU( Of •Ilgl^U lehooU oa p«f« 2^Xtan 3A 



aiAOi LiviLS siavio 



Olfleill»rtON 0^ GHAfTIA 1 aidVlCat (My« Ifif iutf« MtlvllM l« ini»r««« MM tM amH < 



Scudcnc Asalsttnct TtAma (conslsclng of 
counialon, social vorkars* and paychologlacs) 
will ba aicabllihad co provlda Chapcar I 
scudane asalacanca wlch aeadaaic, aecandanca» 
soelo-amocionaU and haaleh probLaaa. 
Sarvlcaa will Includa acraanlnf , dlagnoala, 
•valuadon, and in e a even c Ion aa nacaaaary. 
In addlelon, cha Scudanc Aaalacanca Taaaa will aaalac cha faalllaa of 
scudanca vho- have MhlbUad Idanclflad problaaa and will aaka rafarrala. 
CO approprlaca aganelaa vlchln cha cosmalcy. 



□ 
□ 
□ 



M Om 

a«a)MMi«M euat 



OfiMf <t»— i»fi SCttdant Aaal a t ^ea 

— fn» 



PiAH $on cooaoiNATioN wiTN agouu* iNtraucnoHAi. paoMAUt 

Tha Scudane Aaalacanca Taaaa will provida inforaAtion and craining co 
paranca» caachara* and ptincipala on cha purpoaa and aarvicaa avallabla 
from cha caaaa. Tha Scudane Aaaiacanca TaasA will coordinaca chair af fores 
wich cha Chapcar I and tagular aducacion caachora co plan and implaaanc 
alcamaciva iaacruccional aacho4a» cachniquaa» or adjuacaanca which could 
ba fsada in cha cIaaarooa« Aaaiacanca will alao ba providad in da«Ung 
wlch aocio-'aaocional and bahavioral problaaa. 



AvaaAoa wagjuY Ting aacn gmio aacaivga cma^m i Mnviciat 



cHMTga 1 trup mi thm commimt 



, , P ifii i ai mmrt a ( 1 • SrI CouTiaalora« 1 . 5rTS. Social 
; ^ 0HH# tfiiir^*^ Vorkara^ fXt yaychologiaca) 
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J. PnOGAAM OtSCRimOM 

Ch«d(Qf^ONL A itpMtpigt must btconpiitid for cacti typ«o»M^ 

□ lUHiMTAJif iif AOina [3 $lco#«A«^ MATH £iem«nt«ry 

i : ILIHIMTAIIV HATM QtMH <t— <tyt Af f r"3chooI/gxC€Pd<d 

~* Day Progm 



•uiwotNai SMviO: St« lilt Of •Uglblt bulldtng« on Pagt 3, I OMOt Liviu iiiviO: 



th« Af ctr*SchooI/ExCtnd«d Day Program s«rvts 
studtncs who partielpact in ch« Chapter I Pro* 
gram durtng cbt rtgular school day. Tht program LJ 
provldtt for additional Inttructlon In reading nmityi Af ter -Schoo 1 / 

and/or natht oat lea . Entry Into tht program is ^ Extendtd Day ? 

baaad on naad. Class sizes rang* from 5 to 10 iii t$m ipfiri 

and op«.ratts for ont hour aftar school, two to four days par waak. tht 
program foeusas In on dlfftrtnC approaehas, usa of computars, nawspapars» 
Scholastic and Raadlng For Succass Programs, and manlpulatlva^. Learning 
approaehas and matarlals will focus on tha davalopmanc of both basic skills 
(t.g., vocabulary davalopmant, computation) and mora advancad skills 
(a.g., comprahanslon, concapts and applications)* 



gram 



PUiH POn COOiOIMATtON WITH AiOUUA IMtTflUGTIOIML PHOOlAllt 



A£tar*School/ExCandad Day teachars vlll ralnforca, extand, and support 
classroom lassons In raadlng and oathaoatlcs and discrict*wlda objectives 
in reading and mathematics at each grade leveU 



AVlKaal WtUkf TIMg lACM GMkO AlCIIVlS CMamt I SliVtCIti 

2 to 4 hours 



CMAf TIA 1 tTA^P Nlll mm GOMMMtMT: 

em 

83 TiiufiifB Partlclpaclrig teachers sre psld 

on an hourly rats* 



^sfiar H ei K sweii 
Otue* taaeedkel. 
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J. PROGRAM DESCRIPTION 

ChtckonfyONE. A $«p«mt pagt must M oorrplettd for tacti ryp« of s«fvct. 

ri IIIMINTAIIY RIADINO WOUO All V MATH 

I 1 limiMTA^r MATH Q OTHjii CM*itv> Computer Aislstcd Lear ning Lab/ 

After School, 7Ch chru 9th 



•UlLOINat tlRVIO: 

Central Jr. , North Intemedlace, Webber Jr. 



OAAOC tlViLt sievf 0 

7th chru 9th 



OCSCei#TION 09 CHA^Tie 1 ieevieit (M M ln«iue« tMlvtUM i» imfr^vt MM« nitrv teYmM •kllU): 



The Compucer Aeelited Learning Lab serves H] »giioyi 

scudence who parclcipate in the regular Chapter L pn 
prograo during che regular school day. The program^ 
provides for additional instruction In Reading and/ Q « mi cut • 
or Mathemaclcs. Class sizes range from 10-15 and ot>iefCMt*N> Computer As s i 

operates for 2 hours afcer school for four days per^ Lab/After Schooi , It 
week. The program will use specially designed incer- rtA^aa AU f*ai tjipiir) 
accive software. Learning approaches and materials will focus on 
the development of both basic skills (vocabulary development and computation) 
and advanced skills (comprehension, concepts and applications). 



ed Learnt: 
thru 9th 



^UM P09k cooeoiMAnoN mrm siauuff iMtrsuenoMAL snoosAiit 

The Computer Assisted Learning Lab teachers will reinforce, extend and support 
classroom Lessons in reading and mathematics and district-vide objectives 
In reading and QAthematics at each grade level. 



AViiiAM wimr vm iacn oeui sictivis cNA^tiff i si evieasi 

I t-o 4 hrw. 



CHAma 1 vr AfP Mft vm conMntiirt 

3 Tmiiire (psrtlcipating teachers are paid on an hourly rate) 

« isines< 
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1989-90 BASIC APPLICATION 



39 43«t 



J.J^nOGRAMOtSCAIPTIQN 

Ch«ck ontf ONE. A stparatc p«g« must bt oonipl«(td for tacn typt c4 s#rvic«. 

I IIIMINTAIIV fliAOINOi IICOMOAHV HATM 

i"! f IIUIMTAIIV MAtH 



QI OTWimffttitvi Stcondary After School tucoring 

Gradt'i ) chru L2th 



luicoinas iiivii>: 
CtnCril» CYorth, V«bb«r Jr. 



OflAOl liViLt SIAVIO 

7 chru I2ch 



OIlCMlPtlOM 0# CMAPtCN ) StHVlCIS (MuM Iit«iu4« •MlvitlM i« imprava itwa an* •ivaaaai tftiiitH 
Th* Secondary Aft«r School Tucorlng progrM t«rv«t ilud«nca 
who parctcip«c« in ch« Chapctr I program during Lj 
th« regular school day. The otogram pro^idoa for m «»f «it* cn»*r««m 

additional instruction in reading: and/or aathematicL^ 
CUse sizes will range froa 5 to 10 students per Lj "••••••^•^ ctMi 

teacher and operate for 2 hours after school for Q Otner (•§— 
four days of che week. Learning approaches and 

auterials will focus on the development of both basic iAa# M#*r> 

skills (vocabulary development, computation) and more advanced skills 
( comprehension t concepta and applications). 



iUN fon cooaDmartON wxth aiauuH iMsmuenoNau paooaaii! 

The Secondary After School Tutoring program will reinforce, extend and support 
classroom Lessons and district-wide objectives in Reading and Mathematics 
at each grade level. 



AVliMft VtlftLY Tina SAGM OMMI MOtlVVS QMaaTU 1 BItiVIGUi 

I to 4 hrw. 



CHAm« 1 wrup MR mi ooiiPsr;twri 
Ob 

S Tmmre (p«rci6ipatloi teachers are paid on an hourly rate) 
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J. PROGRAM DESCRIPTION 

Check only ONE. A stparatt pagt must t)t complttid for tacti rypt of strvct. 

] ^HIK SICONOAiT AIAOINQ 

IICMINTAMV ilAOlNa StCONOARY MATH 

~| IL«MINTA«V MATH |T] OTHtR ($M«tfy> ProjeCt SUCCESS 



SP-40II 
(*M* 



•UlLOINaa StKVCO: 

See list of eligible schools on page 2, Item A-B 



GHAOt LCVIU9 SCAvEO 

1-12 



OISCNIPTION OP CHAPTIR 1 SIRVICIfl (MutI Iflc(u4« Mlivititt !• impravt »ttic mOfC Mv«A«t4 tktiity: 

Project SUCCESS will focus in on those d 
students who have not made any academic | ci«.,oom 

gains in the past two years and for whom z:^ 

a special plan for assistance must be ' i "••u««mt»ii cim« 

developed. Activities will include: ,^ othf (Mti^v) Project SU CCfcSi 

establishment of study centers in churches ana 
community centers, recruitment of business all tpi*t wtf> 

and industry for mentors and an Adopt-A-School Program, 
recruitment of other volunteers to assist with the program* 
providing information and training to parents, and making referrals 
to other agencies in the community. 



PUN ^OP COOPOINATION WITH PtOUlAi INflTPUCTlONAl PIOOPAU: 



Project SUCCESS staff will work with Chapter 1 and regular 
education teachers to identify, assess, and develop plans for 
student program improvement for students who have not gained 
in performance for the past two years. 



AVMAat WtlKLT TiHt UCH CHILD PKCIlVIt CHAIBTM 1 SIPV>C11: 



CHAPTin 1 STAPP POP THIS COMPOMtMT: 

£11; 



TtMPM 

PTE Project SUCCESS Spocialist and 
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SGBOOL DISmCT OF TEE CITT OF SAGINAH 

DDAKMKVr OF EVALOATIOI, TBSTIK k USIAtCH 



TO: Foittr B. Glbbs 
Mary Clolek 
Ron Schneider 
Don Scott 



FROM: Barry E. Qulmper 
Richard N. Glaus 
Paul Kurecka 

IK: Phase I Process Evaluation Fact Finding and 
Suggestions Concerning Chapter 1/Article 3 
Pupil Service Team (PST) Process and Project 
Success 



DATE: December 2, 1991 



Eight respondents (Ron Schneider, Gene Nuckolls, Williaa Cheaney, Bob 
Jamison, Craig Tatua, Mary Ciolek, Don Scott, and Chris Duadas) were 
interviewed between Novenber 14 - 22, 1991 using a structured interview 
guide (see attachment A). Their responses were tabulated and analyzed 
to determine operational details. As part of this analysis a number of 
variations were also determined. Below are the results of this 
analysis and suggestions for improving operations. 



Agreed Upon Operational Details 

• The Pupil Service Team (PST) process is run by the social worker 
and Initiated by teacher recommendations. Social worker puts 
together the PST. 

• They understand the three year, two year and one year student need 
criteria. PST meetings result in action plans. There art (ill- 
defined) periodic reviews and a case, review at the end. 

• If an action plan is initiated and Success service is Indicated » 
Project Success is in play. Success a2so does some things inde- 
pendently, e.g., Mentoring and Adopt- A- School. 

• Comaitaent varies from site to site. Tlie building principal is seen 
as key. 

e It is too early to determine success of r.hese ventures. 

e PST is behind its established timeline. Time constraints ar« 
evident. 



e Craig Tatum recruits volunteers for study centers and Adopt-A- 
School and Mentor programs. 

e Craig Tatum does not monitor whethtr child Is Chapter 1/Article 3 
or not. 



e One person should oversee entire PST and/or Success Process. 

Er|c " 7fi 
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• There Is a need for an overall Inservlce, but it Is unclear who 
is responsible. 



Variations In Operational Details 

• PST review process (tlaellnes, etc*} are not defined* 

• The procedures for filing action plans (copies) beyond the CA-60 and 
social workers Is unclear* 

• Definition of what constitutes a completed action plan Is needed* 

• Volunteers^ roles seem unclear* 

• Specify the number and location of all study centers* 

• Success and FST are serving some students who are not identified for 
Chapter 1/ Article 3 services* 



Suggestions 

The following suggestions are not meant as directives nor meant to be 
an exhaustive list of enhancements* There may be other methods by 
which the Intent Chey seek to address could be achieved* 

• One person should be assigned to oversee PST and Success activities* 
Such a person wuld be in a better position to bring consistency 

to PST/ Success* This consistency of operation would Include the 
following: Chapter 1/Article 3 eligibility verification processes, 
provide communication between and within organization units involved 
with PST/Success and inspire* where lacking, commitment to 
PST/ Success outreach efforts* 

• A specific definition of what constitutes a completed plan should be 
developed* with attention given to whether completed refers solely 
to fact-finding* discussion* and prescription or if treatment and 
case reviews are included* 

• Volunteer roles* e*g* , how the roles are determined and how volun- 
teers are screened for abilities* should be specified* As well* a 
listing of all study center sites (both on and off campus) should 
be completed* 

• An inservlce* or set o'^, inservices* should be developed to fully 
laform personnel (district-wide) of the scope* nature* and impor- 
tance of the PST/Success processes* 

• The PST/Success process should not be limited to just those students 
recommended by a teacher* All Chapter 1/Article 3 students with 
three and two (and perhaps one) years no gian status should have 
action plans developed for them* 



B£q;RNC;PK/ms 
Attachment 



APPEHDIZ S 



1991-92 CHARn 1 PIOJICT SDOCBSS AMD POFIL SmiGI TEAM (PST) 

piocsss iTALomov ivTzif in ron 

(PHASI I) 



Intsrvlemr: 
Intcrvicwtc: 



1. Could you explain how Project Success end PST process work together? 

Yes If so, indicate the relationship between different 
staffs and departments and also outside agencies 
that may support the activities? 



No ••• I. so, explain the PST process or Project Success in 
isolation? 



2. To your knowledge, has any inservlce training which focuses on 

Project Success and the PST process occurred during this school year? 

Yes ••• If soy what training has been held? Who was trained? 
Training Session Who 



No ••• If so, why not? 



BEST COPY AVAILABLE 
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3. Ultlaat«ly> is thsrs a slnglt person vho ovsrsscs all thsss activities 
in charge of both Project Success and the PST process? 



Yes If so y who? What type of admiiiittratlve function 
does he/she perfora (supervise^ coordlnate» etc.)? 



To who« does this person report about progress 
of these actlvies? 



Mo If no» why not? 



4a. What supervisory task do you have relative to Project Success? 



4b« What supervisory tasks do you have relative to the PST process? 



5m What are you telling your staff relative to prioritizing student needs 
(vlth which students to work first)? 



APPENDIX E 

6« Do you or your st«ff aaiatala a atudtat actioa plaa file? 
Yes «•« If 80y where? 



No •«* If 80» vhy not? 



7« Whet commuai^ tioa systeme ate used by you or your ataff to Iceep 
Project Success aad/or the PST process on track? 



8. What on^golcig dlagaosls, assessment, and progress reporting do you or 
your staff use for Project Success and/or the PST process? 



NOTE : If respondent works with Project Success, ask the following 
questions (if not, skip to the next note after question 17), 



9« Who helps Project Success recruit volunteers? 



10« How are volunteers being used by Project Success? 



11« Which businesses are participating as oMintors or adopt-a-'school workeral 
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I2m What population doM GAP s«r7« and what typa of sarvlca do th^ty 
racalva? 



13* What Project Succeaa actlvltlaa art coordinated vlth REAP and GAP? 



14a. What Involvenant » if any» do you or your ataff have la tha eatabllab- 
nant/oparatlon of tha alaaaatary achool aantor prograa? 



14b. What Involvenantt if any» do you or your ataff hava In tha astabllsh- 
aant/oparatlon of tha adopt--a'»achool program? 



15« What proceduraa do you or your staff use to verify that only coapen- 
satory education atudenta are aerved by tha PST procaaa and Project 
Succeaa? 



16. Where are tha Project Succeaa student centera located? 
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17* What tfpmB of arr«iig«a«Qts and conaitiianta do you aod /our staff hava 
for oparatlog tha atudy eantara? 



NOTE ! If thla parson la dlraetLy InvoLvad In tha FST procass^ pleasa 
ask tha following quastlona. (If not» skip to tha next nota following 
question 23.) 



18* At each building what parson Is raaponalbla for initiating and coor- 
dinating tha PST process? 



19. In general, how successful are they at coapleCing the PST process? 



20* Who receives a copy of tha student action plana onca they are developed? 



21« How do you or your staff know that an action plan la coitpleta? 



22. How awny action plana hava been completed to data? 
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23c Do you sonlCor th« aaouat of ciadi your staff logs for rslmbursemtnC 
- by tba coapccuiacory •ducatloa progtM? 

Ymm ««« If 80» what do you look for? What action^ If any, 
hava you takan to data regarding your aonltorlng? 



No .«« If 30, why not? 



NOTE: Aak tha following quaationa of thoae reapondanta involved 
with either Project Succesa or the PST proceaa* 



24. What expected and unexpected positive outcovaea of the Project Succesa 
and/or the PST procaaa have you found? 



Circle All 
That Apply 

PST Success 

PST Success 

PST Succesa 

PST Success 

PST Success 



Expected Qutcor ^s 



Unexpected Outcomes 



2S. What expected and unexpected negative outcoaes of the Project Success 
and/or the PST process have you found? 



Circle All 
That Apply 

PST Succesa 

PST Succesa 

PST Success 

PST Success 

PST Success 



Expected Qutcoaes 



Unexpected Outcomes 
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26m If you had aor« authority/power, what changci^ would you oake to Improve 

Project Suceaaa and/cr cha PST proeaas? Why? 

Circle All 

That Apply Chaage Why 



PST 


Success 




PST 


Success 




PST 


Success 




PST 


Success 




PST 


Success 




PST 


Success 




PST 


Success 




PST 


Success 





ERIC 
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imQKsnc sassjEf's text keying; nwerical soore cx»versign 

TO BASIC RfiADINS E£VELS. 



The Text Reading Levels are roughly equivalent to the tollcwinq basal reader levels: 


A-2 


Readiness 


22-24 


Grade 3 Readers 


3-4 


PPl 


26 


Grade 4 


5-6 


PP2 


28 


Grade 5 


7-8 


PP3 


30 


Grade 6 


9-12 


Primer 


32 


Grade 7 


14-16 


Grade 1 Readers 


34 


Grade 8 


18-20 


Grade 2 Readers 
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